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Description of Evaluation Report Seri( 

The Comprehensive School Mathematics Program (CSMP) is a program of / 
CEMREL,, Inc., one of the national educational laboratories, and is funded by 
the National Institute of Education. Its major purpose is the development of 
curriculum materials for grades K-6. 

Beginning in September, 1973, CSMP began an extended pilot trial of its ^ 
Elementary Program. The pilot trial i §^ longitudinal in nature; students wf^o 
began ujing CSMP materials in kindergarten or firsl| grade in 1973-74, were 
able to use them in first and second grades respectively in 1974-75, and so on 
in subsequent years. Hence the adjective "extended". 

The evaluation of the program ip this extended pilot trial is intended to' 
be reasonably comprehensive and to supply information desired by a wide 
variety of audiences.- For that reason the reports in this series are 
reasonably non-technical and do not attempt to widely explore some of the 
related issues. The list of reports for .previous years is given on th^ next 
page. ■ ' ^ ' / 

The Sixth Grade Reports are: ' 9-A-l^ Summary of Student Achievement, Draft 

Report 



9-A-2 Summary of Implementation Data Draft 
, Report ^ 



f 9-B-l Sixth 'Grade-mNS Test Data 

9-C-l Sixth Grade Evaluation: Teacher 
* ' . ' - ^ , Questionnaires 



« 
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EJctended Pilot THals of the 
Comorehensi ve Schpol l^athematics Program 

. Evaluation Report Series 



Eviluation^ReQort 1-A-l 



(1974) 



l-A-2 
l-A-3 
1-3-1 
1-8-2 
1-3-3 
1-3-4 
1-3-5 
1-3-6 
l-C-l 
l-C-2 
l-C-3 
l-C-4 
l-C-5 
l-C-6 



Overview, Desi,gn and Instrumentation 

£;ttemal Review of CSMP Materials 

Final Summary Report Year 1 

^^id-Year Test Data; C5MP First .Grade Content 

End-of-Year Test Data: CSMP First Grade Content 

End-of-Year Test Data: Standard First Grade Content 

End-of-Year Test Data: CSMP Kindergarten Content 

Tes't Data on Some General Cognitive Skills 

Summary Test Data; Detroit Schools 

Teacher Training Report 

Observatfons of CSMP First Grade Classes 

Mid-Year Data from Teacher Questionnatres 

End-of-Year Data from Teacner Questionnaires 

Interviews with CSMP , Kindergarten Teacner^ 

Analysis of Teacner Logs 



Evaluation Report 2-A-l 

(1975) 2-3-1 

^2-3-3 
2-C-l 
2-C-2 
"2-C-3 

Evaluation Report 3-3-1 

(1976) 3-C-l 

Evaluation Report 4t^-l 

(1977) 4-3-1 
4-B-2 
4-3-3 
4-C-l 



Final Summary Report Year 2 

Second Grade Test Data j 

Readnrini strati on of First (Srade Test Items 

Stuoent Interviews 

Teacner Questionnaire Data 

Teacher Interviews, Second Grade 

Teacher Interviews, First Grade 

Second and Third Grade Test Data Year ^3 
Teacher Questionnai're Data Year i 

Fir^l Surrenary Report Year 4 - 

Standardized Test Data, Third Grade 

Math4?iatics Applied to Movel Situations (M^S) Test 

Individually Administered Problerns, -Third Grade 

Tea$iher Questionnaire Data, Third Grade 



Data 



Evaluation Report 
(1978) 



5-C- 



1 , Fourth Grdde KANSVest Data 

2 Iftdividually Admitiistered Problems, Fourth Grade 
1 ' Teacher Questionnaire and Intervievy Data, Fourth- 



Grade 



.Evaluation Report 6-3-1 
(1979) < 6-8-2 
6-C-l 



Evaluation 'Report 
(1980) 



•3-1 
•8-2 
.3-3 
•8-4 
^B-5 
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Comoarative Test Data: Fourth Grade 
.Preliminary Test Data: Fl.fth Grade 
Teacher Questionnaire Data: Grades 3-5 

Fifth Gradt Evaluation: Volume I, Sumpary 
Fifth Sride Evaluation: Volume II,- Test^ Data 
Fifth Grade Evaluation: Volume. Ill, Non-Test Data 
Re-evaluation of Second Grade, Revi^sed MANS' Tests 
Achievement of Former CS?^ students at Fburth Grade 
Student Achievement, Rapid Implementation Model 

'k * / * 

Sixth Grade Evaluation, Preliminary S.tudy ' 
'Evaluation .of Revised Second Grade, MANS Blue Level 
Evaluation of Revised Third'Grade, MANS Green Level 
Three Evaluations of Gifted Student Use ' 
Preliminary Study of, CSMP "Graduates'* 

Key to Indexi^f\q 

Evaluation Reports are labelled m-X-n,.</; 

where '•m" is the year of the pilot ^tady, Vith 1973-74^ as Year^J. 
'•X" is the type of data bei no v. reported where A ^or, over- 
views and summaries, 8 is 'for 'Studeaj^'^butcomes and C 
is, for other data, 



7- B-6 

.Evaluation Report 8-B-l 
(1581) 8-8^2 

8- 8-3 
8-8-4 
8-C-l 



Is the number within, a qiveir y,eaf and' type of data. 

^ ^ — I — . — ^.^^ — . . 
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^INTRODUCTION 

- In the Spring of 1982, a series of mathematics tests was administered to 
27 sixth grade classes using the Cgmprehenrsi ve School Mathematics Program and 
to 31 comparisdn classes usiag more traditional programs. The results of this 
testing are described in Evaluation Report 9-B-l • . ' 

This report 'describes non-test data i:ol lected from these classes including 
implementation data .and teacher attitudes. ' ' ^ 

.Setting. The 26 CSMP classes represented about half of the sixth grade 
CSMP classes that year. The remaining CSMP classes were not tested for one of 
several reasons: They did not begin CSMP until sixth grade, testing woultft 
have be'en too expensive b£cause pf remoteness 'or a single-class site, or onTy>: 
some classes in a district ^were tested to prevent over-representation of that * 
district* 

The 37 Non-CSMP classed came from two sources. First, in some districts! I 
CSMP was being used at sixth grad'e in some , but not all, of the schools in th^ 
dfstrict; fifteen Non-CSMp classes were selected from such schools. Second, '"., 
in other districts, CSMP was being used in a]^ the schools of the district; in| 



that case Non-CSMP classes were recruited from similar schools in other CSMP 
districts^which had .r^ot yet reached sixth grade in their 
There vyere 32 such classes. 



This combination of school level selection within district and use of CSMP 
schools in other districts reduces the likelihood of there being consistently 
better teachers in the CSMP classes compared to the Non 



CSMP implementation. \ 



:SMP classes. 



Table 1 oh the following page shows the distribution of. classes 
participating in theiesting. 



Site 

Desiqpation 

, f 

2 . 
3 



5 
6 

7 
8 

9 
10 



Table 1 

Wstribution of Participating Classes 



Number of Classes 
CSMP Npn-CStjlP 

6 



0 



7* V, 



8 

0 
6 

2 

0 



Total 26 
*Upper track classes: 



2 
5* 



0 
6^ 

6* 

0 

2 

6* 

37 



Type of 
Conmunity 

Med i um ^ i ty 

Exurban 

Inner suburb 
of large city 

Suburb of 
♦ medium city. . 

Small city 

t 

Suburb of 
large city 

Large city. 

Suburb of ' 
small city 

L'arge city 

Mec^ium city 



Approximate Socio-Economic 
Backqround of .'Classes Tested 



Upper middle/Middle 
Middle/ Lower middle 
Middle 

Middle/ Lower middle 

Middle/Lower middle 
Upper/Upper middle 

Upper middle/LoH^r middle 
l^per middle 

Upper middle/Lower middle 
Upper middle 



i.e. students specially grouped by ability. 



Except for districts 3 and 5, all CSMP Classes had studied XSMP since 
kindergarten or first grade. In those two district, however, the students 



began the program in third grade and fifth grade, respectively. 



Based on scores from the vocabulary test, administered to all classes, the 
n-CSMP classes were slightly higher in ability than the 26 CSMP classes. 
In general, the students tended to be far above average in ability, with 
approximately half ofHhem scoring above the-75th percentile on the vocabulary 
teat for both' CS*MP;and Non-CSMP. ' 
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IMPLEMENTATION 

This section summaries responses to questions about the implementation of 
the program and teachers' experience and training. Questionnaires were ■■ ^ 
returned by 22 CSMP teachers, representing 27 CSMP classes and by 26 non-CSMP 
teachers, representing 31 comparison classes. Data reported are based on 22 
•and 26 teachers respectively, except in the odd case where teachers d-id not • 
respond to an item or set of items and that is indicated in the tables. 

In all instances, the* first entry is the percent of CSMP teachers 
responding; .the second entry is the rp^nses of the comparison set of 
non-CSMP teachers. * 



1. Teacher Experience 



First Year 

2-5 Years 

6-10 Years 

Morei than 10 Years 




CSMP 
0^ 
04% 

V3% 
■ 73% 


Nnn-r"sMP 

■ ..0% 
, 08% 

1 OA) 

77% 


At what grade levels have you taught math 


(and CSMP): 






Math Experience Generally 


CSMP Experience in 




CSMP 


Non-CSMP 


Particular 


Just Sixth Grade 


' 23% 


4% 


55% 


Sixth Grade Plus 
Lower Grades , 


55% 


52% 

* 


f 

27% 


Sixth Grade Plus - 
Higher Grades 


4% 


20% / 




Sixth Grade Plus 
Lower & Higher Grades 


18% 


24% 


\ 
\ 


No Response 






.18% f . 



Both group of teachers are quite experienced; about three fourths of them 
have at least 10 years^ experience . * "Non-CS^IP teachers have a little more 
diversity in their experience* * 

•CSMP teachers are similar in teaching experience to nOn-C5MP teachers. In 
both groups, more than seventy percent of the teachers surveyed had more than 
ten y;ears experience-and neitha(^ group had first year teachers, 

A majority of teachers in both groups have taught sixth grade and lower 
grades, and a similar number of teachers in both groups have taught sixth 
grade, plus both, lower and higher grades. However, whi le a quarter of the CSMP 
teachers have taught only sixth grade, versus 4% of the non-€SMP teachers, 
only 4% of them have taught sixth grade plus higher grades, versus almost a 
quarter of the non-CSMP teachers. 



Classroom Data 



f 


Percent Responding "Yes" 
CSMP ^ton-CSMP 




Are classes ability groupe"d? 


50% 


,60% 




Is homework regularly assigned? 


68% 


88% 




Do you make use of hand calculators? 
• > 


91% 


^31% 


• 


* Do^you regularly have .an aide 
assigned to your classroom? 


J 8% 


'l2% 





*^CSMP teachers said aides were responsible for checking workbooks, 
assignments, and stud^ts* desk work, and Non-CSMP teachej:*s reported aides 
were responsible for working with Special Education students or individual 
students. 



CSMP and Non-CSMP teachers were similar in that roughly half their classes 
were ability grouped, homework was regularly assigned to a majority of their 
classes, and few had aides regularly assigned. However; three times as many 
CSMP classes as Non-CSMP classes used hand calculators. ^ 
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"How many minutes are mandated by your^ distr.ict/schoo'l for math?" (if 
applicable} 



Less than 30 • 
30-44 
•45-55 
56-*60 ^ 
>60 • . 

I ' ^ 

Hb response ( probably njd mandate) 
Mean number of minutes 



4 



CSMP 



05% 
41% 
09% 



45% 
51 



No n- CSMP 



04% 
35% 
08% 



53% 
48 



"On the average, how much time- does your class spend on math each day?" 

' No n- CSMP 



Less than 45 mi^nut^s 
45-50 minutes 
51-59 minutes 
60 minutes 
> 60 minutes ; 

Mean number of m'inutes 



TSmF 

0% 
45% 
25% 
20% 
10% 

54 



04% 
56% 
12% 
28% 
00% 

51 



CSMP and Non-CSMP classes were also similar in 'the amount of time mandated 
for mathematics instruction; only about half the teachers reported a mandate, 
^usually 45-55 mi^iutes. , The mean number of minutes actually spent in math class 
was also simila*- ( 5.4 versus 51 minutes ). 

^ "About what percent of this time is spent- on: teacher-led work? small 
g>*oup work? individual work?" * 



! Teacher-led work 
J Individual work 
1 Small group work 



CSMP 

^ 67% 
.11% 
22% 



\ 



N^n-CSMP 

'.44% 
19% 

37% 



ERIC 



dSMP teachers spend- more time on teacher-led work than their non^CSMP 

counterparts, and -less* time on individual and small group work. twice as much 

of CSMP teachers' time, is spent on small group work versus work with an 

» 

individual student. 
- "During a typi^cal math class, what percent of y(^r time is spent on: " 



4 




CSMP ^ 

r 


No n- CSMP 


Developing a lesson at the board 


Mean. 


■■ 52% ^ 


33% 


'(or' in front of the class) 


Range • 


(2 5% -80%) 




Supervising while students do work 




• '16% 


. ' 26% \ 


on, their own (other than tests') 




(•08%-30% ) 


(?oro-60%) 


Leading th^9s;^^ss in reviewing 




09% 


17% ' 


assigrynents they have completed 




(02%-25%) 


- (05/0-40%) 


Working individually with a student 




11% 


19% 


. or small group of students 




. (08%-25%) 


"(02%-50%) 



As might be expected, CSMP teachers spend a majority (if their time 
developing a lesson at the board \^ile Non-CSMP teachers' time wds more evenly 
distributed across a^ll four categories.. 



'*What textbooks, if any, are you currently using in your classroom?" 





CSMP 


Non-CSMP 


Scott-Foresman 




58% 


- Addison Wesley 




J 5% A 


Houghton-Miffl in 


14%* 


12% • 


Harcourt Brace 




04% 


D.C. Heath 




04% 


. Local County Guide 




04% 


Local Pilot Program 


V 


04^ 


"Homemade" Materials 


05% , 




(Non-CSMP totals exceed 


100% because teachers reported using two texts 


or programs. ) 







o 
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Very few CSMP teachers Vfeported using materials other than CSMP material 
*a "tradttlonal" text to sfEjpplement CSMP and "hof^made" materials produced by 
teacher. ' • ' ' 

3* Lesson Coverage . ^ • ^ . - 

i 

Suppleitienti ng 

"D(J you supplement your regular math program witfi additional activities?" 





CSMP 


' Non-CSMP \ 


Yes 


93%. . 


100% 


No , 


0% 


"0% ^ 


No response 


07% 





"If so', what topics do you cover?" (Responses sum to more than 100% because 
multiple responses were given.) 





CSMP 


Non-CSMP 


Basic operations (whole numbers)/ 


50% 


08% 


computation ' 






Basic operatiohs with fractions 


36% 


04% 


Fractions * 


18% 


04% 


^ gasic operations with deciritals 


23% 


08% 


Decimals 


14% 


08% 


Word problems 


09% 


23% 


Percent 


23% 


04% 


Geometry 


18% 


15% 


^ Metrics /measurement , / 


23% 


15% 


'Mental arithmetic/estimation 


05% • 


15% 


Prime numbers 


05% 




Negative numbers 


05% 




Logic 


* 05% 


^04%' 


Probabil ity 


05% 


04% 


Algebra ' 




04% • • 


Number theory. * 




04% 


Scale drawing * 




04% 


Introduction to statistics 




04% 


Set theory 




04% 


Interest rates 




04% 


Computers/calculators /abacus 




19% 


Ba^es 




08% 


Graphs ' \ 




08% 


Problem solving 




12% 


Math lab /games 


05% • 


■ 26% 



"Is this supplementing usually for:... " 





CSMP 


fton-Cbrip 


( 


/ 


A tew imnuLes i ^ 




C 0/0 


A full math period 


18% 


]5% 


Several consecative math periods 


05% 


35% 


Other 


■ 05% 


M2% 


No response 


14% 


15% 



J - 



"does it usually occur: 



Oa^ly 

Two to four, times a week 
Weekly. 

Twp" to .three times a month 

Monthly 

Oth^r 

No response 



27% 
18% 
18% 
14% 
09% 

14% 



No n -CSMP 

'09% 
28% 
13% 
28% 
08%. 

T4% 



"Over the course of the year, about what percent of the math time is used 
for this supplemental work?" 





CSMP 


No n- CSMP 


None * 


0% 


0% • 


Less than 10% 


23% 


23% 


10-19% 


36% 


36% 


20 - 29% 


14% 


18% 


30 - 39% 


09% 


04% 


40 - 49% 


0% 


04% 


50-59% 


0% 


0% 


Greater than 60% 


o%~ 


0% 


Na response 


18% 


15% 


Mean percent 


14% 


14% 



Both CSMP ^'nd non-CSMP teachers supplement^an average of 14% of the time, 
but there are differences between the two groups on what is supplemented. 
Many more CSMP teachers supplement the program with basic 
operations/computation exercises, using whole numbers, fractions and 
decimals.. Other topics CSMP teachers supplement with are geometry, metrics, 
and percent. In contrast, non-CSMP teachers supplement over a broader array of 
topics including many that cou4d be ca'hed "enrichment". 
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• ^Supplementing patterns differ from CSMP lassrooms to non-CSMP 
classrooms. While the majority of CSMP teachers supplement for a few minutes 
each day, non-CSMP teachers tend to supplement for longer periods at a time. 

"Were there any skills or concepts that yolir present math program assumed 
students would know at the beginning of the year, which, in fact, many did nojt 
know?" ' 





CSMP 


Non-CSMP 

1 1 w 1 1 w III 


.No 


32% 


42% 


Yes, basic number facts 


23% 


12% 


p.lace value * ^ 


14% 


15% 


mental arithmetic 


05% 


31% 


algorithm for whole number 






mul tipl ication 


09% 


04% 


algorithm fop whole number division • 


23% 


04% 


familiarity with fractions 


1'4% 


15% 


- operations with, fractioas 




' • 15% 


familiarity with decimals 


09% 


08% 


. operations with decimals 


18% / 


08%, ' 


estimation 


0% 


35% 


word problems 


18% 


38% 


^.geometry , 


05% 


]9% 


'probability 


0% 


15%- 


other (please specify) ' * 


09% 


08% 



"Are there any skills or concepts that you think students should know by the 
end of sixth grade which are not adeqiXately covered by your present math' 
program?" (Check as many as apply) 





CSMP 


-Non-CSMP 


No . 


23% 


50% 


Yes, basic number facts 


09% 


23% • 


place value 


18% 


12% 


mental arithmetic 


.18% 


' 12% 


algori thm-f or whole number 






mul tipl ication 


09% 


04% 


algorithm for whole number division * 


32% 


08% 


familiarity with fractions 


09% 


08% 


operations with fractions 


45% * 


• 19% 


familiarity' with decimals 


09% 


,12% 


operations with decimals 


23% 


o%- 


estimation 


09% 


15% 


word problems 


14% 


19% 


geometry 


14% 


04% 


probability 


14% 


08% ' 


other ^(please specify) 






Area, volume perimeter (CSMP) 






Problem-solving, measurement (non-CSMP) 


• 





I 



At the beginning of sixth grade, according to both groups of teachers, 
there were few, if any skills or concepts which their students did not know. 
CSMP teachers frequently cited fractions, whole number division and basic 
number facts as skills thfeir students did not know on entering sixth grade. 
Non-CSMP teachers frequently cited word problems and estimation as skills 
their students d,id not know at that grade level. 

Twice as many Non-CSMP teachers as CSMP teachers' indicated that, there wQre 
skills needed , by the end vof Gra.de 5 which were not adequately cov^ed by' their 
programs'. CSMP teachers frequentlj^ cited algorithms for whole number 
division, operations with fractions and operations' with decimals as skills not 
adequately covered by their present program. Non-CSMP teachers frequently 
cited basic number facts, operations with fractions anci estimation. 
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TEACHER ATTITUDES 



Sixth' grade CSMP and Non-CSMP teachers were asked to respond to three sets 
of questions designed to elicit their attitudes .toward their present math 
program. The first set of questions asked teachers to rate the characteristics 
of their math class. The second set of questions asked teachers to compare 
^ their -gurrent math program with the one they had taught previously. The third 
set of questions asked teachers to respond to a se?-ies of questions about math 
instruction for low ability students. 

The next section summa'rizes CSMP and Non-CSMP teachers' statements about 
thp best and worst aspects of their present program. ( A complete listing of 
teachers' responses to both the best and worst aspects is shown in Appendix 
A.) A summary of both groups' overall evaluations of their present math 
program and^ a complete^ 1 isting of teachers' comments is given at th^e 
conclusion' of this chapter. 
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1. Characterise^ of Ma th Class 



Below are several pairs of statements fjor ^our math class this year. 
Please circle theMetter which best describes the relative balance or 
emphasis', between the two. 

A mean -score (M) was derived for each grade^by assigning a score of I to a 
response of A, 5 to E and then taking the average. Thus, the higher the 
mean, score, the more in agreement v^ith the, right-hand statement* 



Achievement is oriented 
towards basic skills. 

CSMP 
Non-CSMP 



B 



C 



9% 32% 19% 34% 
35% 38% 15% 4% 



Achievement is oriented 
towards more general 
progress 

2.9 y 
2.7 



Lesson plans are followed A B 
in great-detail. 



Lesson^^lans serve only 
as a general guide. 



"CSMP;- 
Non-CSMP 

Lessons proceed briskly. 



• CSMP 
Non-CSMP 



-45% 36% '5% 14% 0% 
0% 15% 42%- 15% 27%' 

A B C D • E 



0% .14% 45% 23%' 'l8% 
4% 8% 26% 47% 13%,^ 



1.9 
3.5 



Le-ssons proceed 
thorqughly. 



3.5 
3.5 



Content of lessons is 
challenging for 
most 'Students. 

CSMP 
Non-CSMP 



24% 43% 29% 0% 5% 
8% 30% 48% 13% 0% 



Content of lessons 

easily mastered by most 

students. 

2.0 

2.6 



Best learning takes - 
place when teacher 
leads class. 

CSMP 
Non-CSMP 



0% 27% 59% 14% 0% 
14% ' 33% 33% 14% • 6% 



Best learning takes place 
when teacher works indi- 
vidually with students. 
2.9 
2.6 
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r 



Math cl/ass is one of my 


A 


B 


c 


D. ' 




feth clciss is one of mv 


favorite times of the 












least favorite times of 


schoollday. 












the, school daj^.' 


V . CSMP 


57% 


24% 


14% 


5% 




' 2".0 , 


Non-CSMP' 


35% 


58% 


- 8% 


0% , 




' 1.7/ 


Math class has a business- 


•A 


B 


c 


0 


E 


MatH. class has- a fun 


likq^-atmosphere^ 












'\ atmosphere. 


CSMP 


. 9% 


5% 


50% 


/23%, 


14% 


3.3 ^ 


Non-CSMP 


8% 


19% 


52% ^ 


k 1 2%' 


0% 




Math class is oriented 


A 


B 


c 


D 


E ^ ■ 


o Math class is nripnfpfl 


towards solving 












towards creative 


specific problems. 


» 










activi ties. 


CSMP 


0%' 


/27% 


41% 


27% 


5% 


3.1 


1^0 n -CSMP ^ 


12%!' 


. 50% 


38% 


0% 


0% 


2.3 


Math is one of the 


A 


B 


C 


D 


E 


Math* i s one of the 


harder subjeots to 












ea'sier subjects to 


teach. 












teach. 


CSMP 


0% 


25%' 


30%~ 


20% 


25% 


3.5 ^ . ' 


. Non."^SWP 


0% 


8% 


15% 


58% 


19% 


2.3 



In discussing teachers* ratings of their math classes, differences of .5 or 

greater are deserving of comment. Tlius, it can be said that, compared to ' 

their non-CSMP counterparts, CSMP teachers tended to: 

. follow lesson plans in great detail (versus using them 
a^ a -general guide). 

view the content of the lessons as ch'allenging for most \ 
students (versus being easily mastered by most students) 

. view math. class as having more of a fun atmosphere (' versus \ 
business li.ke ) . . ' 

. view math class as oriented toward creative activities { versus 
specific problem solving). . 

. regard math as one of the easier subjecVis to teach' ( versus 
harder). I . \ 
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2. " How would you rate your ^present math text or mat){^|irogram compared to 
previous math programs you have used on the following J terns? (Please omit 
this question if you have not taught sfxt^i grade matj^with a'^different text- 
book or program.)-" The mean score, given at the rig^ of each Hem, was 
cal4:ulated in the usual way. 



a) Time required for daily pi^eparation" i s /' 

I • , • 

.(less) (about the (more at first b|* * 
e same) about the same ajter 

a year's experience) 
CSMP 05%' 0% . $2%' 

No n -CSMP, 15% 50% 



b) Ov-erarll qual Uy 



(much , 
lower,) 

CSMP 0% 
No n- CSMP 05?; 



(slightly 
tower) 

0^ 
.10% 



30^0 



(about 
the same) 

• 11% 
30% 



(more at first apd con- 
tir>ues to^ be 'after a 
gear's experience. ) 

33% 

05% 



(sj igtrtly 
~ ti^igher) 



" 37% ' — 
■ 20% ■ 



(ji^h 
higher) 

^ .V3%:,' 
355i* 



2.2 
2.3 



4.4 
3.7 



ERIC 





s) /"Student 


\nterest and involvement 


' f 




1^. 




(far 
less) 


(a little 
less) 


(about y, 
the same) 


V 

• 'Ca little 
more) 


' (far-" 
more) 


• M 


Non- 


CSMP 5% ' 
-CSMP 0% ^ 


^ ■ 0% 
05% 


•* 05% 
30% 


32% 
50% 


58% 
15% 


4.4 
3.8 • 




d) Students 


' achievement in 


computational *skil,ls 








(far' 
less) 


(a-^lfttle 
less) 


(about 
the same) 


( a little • 
more) 


(far' _ 
more) 


M 


Non- 


CSMP 10% 
-CSMP -05% 


- 20% 

a5% 


25% 
35% 


45% 
45% - 


0% 
10% 


3.1 
3.5 




e) Students 


' achievement in 


mathematical 


concepts 








(far 
less) 


(a little ■ ■ 
less) V, 


(about 
the same) 


(a little 
more) 


(far 

more) ♦ 


M 


Non' 


CSMP 0% 
-CSMP 0% 


0% .7 
- 1.1% /■/ 

■ / 


15% 
42% 

'J 

14^-^ 


~ 35% 
32% ^ 


50% 
16% 


4.4 
3.5 



f) Students' ability to logical reasoning 



(far 
less) 

CSMP 0% 
Non-CSMP 05% 



(a little 
less) 

0% . 
25% 



(about 
the same) 

05% 

40% 



(a Tittle^ 
more) * 

30% N 
25% 



(far 
more) 

55% 
*05% 



M 



4.6 
2.8 



g) Students' facility in so'lving word problems 



(far 
less) 

CSMP 0% 
Non-CSMP 05% 



(a little 
less) 

15% 
20% 



(about 
the same) 

25% 
30% 



(a litt'le 
more 

40% 
. 45% 



(far 
more) 

20% 

0% 



M 



3.7 
3.2 



h) Appropriateness for jlow ability students 



(much 
lower) 

CSMP 40% 
Non-CSMP 11% 



(slightly 
lower) 

20% 
16% 



(about 
the same) 

. 10% 
3h 



(slightly 
higher) 

30% 
32% 



p^i 



i) Apofopri ateness for high' afai 1 ity students 



(much 
lower) 

CSMP 0% 
Non-CSMP' 10% 



(slightly 
lower) ' 

■ 0% 
15% 



'(about 
the'same 

0% 
15% 



(slightly 
higher , 

10% 
50% 



(much 
higher) 

0% 
05% 



(much 
higher) 

- 90% 
10% 



M 



^2 ..3 
3.V. 



M 



4.9 
3.4 



^ Again, differences of .5 or greater are de^^rving of comment. Compared, to 
non-CSMP teachers. CSMP teachers gave higher ratings than Non-CSMP to the 
fol lowing,; . . ^ * ' ■ ^ — - ■ 
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overall quality 
student interest and involvement ^ 
student acTiievement i.n mathematical concepts 
student ability to dojogical reasoning 
.student facility in solving word problems 

more appropriat^for high ability students and lowerVatings in 
appropriateness for lower ability students 



i 



is 




3. Low Ability Students • ^ 

"Below are given pairs of statements. Please circle the letter which best 
describes what you think regarding math instruction for 'low ability students /' 
and the means were derived as they were for the previous two sets of questions. % 



Best learning takes place 
in a group in which 
various ability levels 
are represented. 

CSMP 
Non-CSMP 



18% 18% 09% 36% 18% 
12% >04% 35% 35% 15% 



Best learning takes place 

in a group in which all 

students are of the same 

abi 1 ity. 

3.2 

3.4 



It is important to 
concentrate on learn- 
ing basic computa- 
tional skills. 

« 

' CSMP 
Ndn-CSMP 



D E 



14% lU 36% 09% 14% 
12% 23% 46% 15% 47% 



It is important to pro- 
vide exposure to a wide 
variety of topics in 
mathematics. . 

2.8 ■ 
2.8 ■ 



Best learning takes 
place in teacher-led' 
situations. 

CSMP 
Non-CSMP 



D E 



02% 24% 33% 09% 

16% 20% 36% 28% 05% 



Best learning takes place 
when students are worki;ng 
individual ly. 
2.7 
2.8 



J 



It is Better to 'touch 
lightly on a new topic 
several times. 

' CSMP 
Non^CSMP 



18% 
04% 



32% 
19% 



27% 
54% 



151' 



a5% 

08% 



It is better to stick 
with a new topic unti 1 
mastered. 

2.6 ... 
2.7 



Special instructional 
arrangements should 
be made for these 
students. 

CSMP 
Non-CSMP 



19% 43% 14% 14% 10% 
15% 27% 38% 15% 04% 



The regular classroom 
provides an adequate 
instructional setting for 
these students. 

2.7 
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16 



9 



Manipulati ves work 
best with these 
students. 

CSMP 
Non-CSMP 



/ 



19% 
12% 



33% 
48%' 



43% 
24% 



05% 
16% 



0% 
0% 



Paper and I pencil wp)"ks 
best with/ these s,t,l|dents 

2.3 
2.4 



It better to set 
goars that wi 11 
insure success. 

CSMP 
Non-CSMP 



A 



27% 
15% 



41% 
46% 



23% 
23% 



09% 0% 
12% 04% 



It is better tjj;set 
goal s/that are;<? • 
chal l/enging. 
2.1 / ./ 



Best learning takes 
place when a teacher 
can.^ive individual 
help. 

CSMP 
Non-CSMP 



45% 
12% 



14% 
27% 



18% 
54% 



23% 
08% 



0% 
0% 



Best learning takes 
pl/ace when/aT teacher can 
w^rk wi th alsmal T 
gy*oup. 
2.2 
2.7 



There were virtually no differences between CSMP and non-C^P teachers.' 
Only for the statement "best learning takes place when a tieachir can ^ive 
individual help" did a difference of .5 occur. Non-CSMP teachfrs were more 
likely to say that "learning takes pVace when a teacher can wark with a small 
group." 



"Does your school prbjrde any arrangements' for your low ability students?" 



• s 


CSMP 


' 5 

11' Non-&MP 


Resource teacher/services/room 


45% 


vf 42% 


Title I teachers/aides 


^18% 


;V? 12% 


Special grouping 


09% 


;V 1 2% 


Smaller cl ass size 




. / 04% 


Tutors /aides \ 


05% 


'n. 15% 


Classroom instruction 


05% 




Unspecified 


05% 


I- . 


No 


09% 


•! . 08% 


No response 


14% 


,1 19% 



Both CSMP and Non-CSMP teachers have special arrangements for low ability 
students. The most frequent arrangement in both groups was a resource room 
and/or teacher, followed by Title I services. Othej arrangements tended to be 
within-classroom strategies like special grouping w" 
"catch-up" instruction sessions scheduled periodica 



thin the class or 
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''Best features. \Asked to comment on the best aspects of the. present m'^th 
program, CSMP teachers mentioned that it challenged students, fostered the 
development of analytic thinking^ and encouraged creativity. To CSMP -teachers 
the fact that CSMP stressed more than basic skiMs was a strong. point , .and 
they, also mentioned that their students were enthused and motivated^by the 
program. 

•Non-CSMP teachers commented tha^ their program^pravided for 
individualization and ability grouping. They thought their programs benefitted' 
average and below average students more than many programs, and commented on 
the organization and logical presentation of their texts. 

Worst^ features. According tt) CSMP teachers, weak points of CSMP included 
the perceived need for traditional algoritms in the basic operations. Some 
teacher^ said the materials eould be better organized and that the spiral is 
too spread out. A few cited the need for more word problems and others believe 
that low ability students are less suited to the program than others. 

\ 

Non-CSMP teachers cited the need for word problems also, for morg problem 
solving and for more variety. ( A complete set of teachers' comments for 
"best" and "worst" aspects is given in Appendix A.) 

n 

Overall EvaluaWon. The vast majority of CSMP teachers gave highly 
favorable evaluations of the program although some teachers thought it worked 
better with high or average ability students than it did with low ability 
students. An often cited strong point was its impact on students* thinking. 
Non-CSMP' teachers, on the other hand, whi'le generally satisfied with their 
programs, stated that it was adequate but dted the need for supplementary 
enrichment. A complete listing of both groups' comments for overall evaluation 
are given on the following pages. 
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"What is your overall evaluation of your ptresent math program?" 
CSMP . . ' . 



4 Excei^lent, ' - - . 

Adequate to our curriculum but no one book does it all. 
With decrease in si,ze of groups, very good. 

It is fantefstlc. ^ ^ ^ ^ 

Continue program for above average students. 

Excellent. 

Good for above average students. - - 

Interesting to feach but could be made better with changes. 
Excel Tent for^strong s'tudents. ^ 
Outstanding, excellefi't, exciting to teach. 

Very good. It covers the basic facts and computation and causes children 
to think and analyze which is not the case in-most traditional programs. 
. 7 I believe I could prepare materials more interesting, more basically 
meaningful, and-more inclusive of psyches of a greater range Qf my class 
members. * 

Super. 'Difficult for non-math oriented to teach at upper grade levels. 

Requires someone who loves math to be effective. 
. . Quite an improvement over our previous proigrams but has flaws that need to 

be ironed out. > ^ ^ 
. ' Definitely above average. 

Acceptable. 

Most teachers in the school, if gjv^n the choice, would not continue with 
this program.' It has many good a/pects, however, which should be' 
incorporated in any math program. I would like to, see a text which could 
be used along with the present materials for a better balance in 
presentation. 

Excellent, sjjper. Children are able to reason and figure out word 
problems much better tharl in years past. 
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NON-^CSMP ' 

Not adequate. We expect to change next fall. 

Adequate and "mare challenging and interesting because of the combination 
of the two. Students are^getting basic skills and concepts. I can keep 
in tOuQh with the ability level of each student as well as offer them 
problem solving challenges. 
B-. * . . 

. I don^t like it. . 
Very good. 

Good.- I am the t.eacher, so I put a lot into it and get positive results. 
Fair. ' There nee'ds to be more available materials for widening skills for 
the more capable students. 

I*m very pleased with-it.' - ^ " 
I think it's super. ^ 

Superior when supplemental material is also included. 
Very good. >^ ' 

I" like it . ^ ^ > f* 

This text is fine if supplemented with other activities. I have yet to 
find a math series that does not need supplements from other resources. 
It's workable. Parents can still identify and get involved with what we 
are doing! , ^ . \ 

B-. 

V Minor improvements could be niade^ but overall the program is good. 
I'm pleased with its results. 
Excellent. ' • 

I am pleased with our presfent^math program.. 

I am more satisfied with it this year than any year I have taught. 
Excellent. 
Very good. 



'J 
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CSMP PROGRAM FEATURES 
• ■ - : " CSMP Teachers Only 

.1 • Questions on the Spiral Approach 

"What do you think of CSMP*s spira] approach, where the teacher goes on to a 
new lesson in a different strand, ev^en thougli not all students may have 
understood the last lesson?" A mean score was derived by assigning a score of 
1 to A, . . . , 4 to D and^ taking the average. 

• (An' arrow (>^) has been drawn to indicate where on the scale the mean* 
response falls, A=l , 0=4.) ' ^ . 



It is less frustrating for the 
students than a mastery 
approach. 



Strongly 
Agree 

A 

18% 



Strongly 
Agree Disagree Disagree 



B 
45% 



C 

32% 



D 

05% 



2.1 



I would prefer spending 2-4 ' A 

consecutive days on a new topic. * 13% 



B C 
39% 35% 



D 

13% 



2.5 



It gives the students time to 
really absorb a topic if they 
are introduced to it in small 
doses over a long period. 



A 

17% 



B ^ 

57% 



C 

17% 



D 

09% 



2.2 



I have to repeat lessons because A 
students don'jt remgmber,. 04% 



B ^ . 'C 

35% 48%- 



13% 2.2 



It only works for some "students. A 
(Please specify_j ) 15% 



B 

35% 



30% 



0 

20% 



2.7 
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Students feel less pressured than 
in a mastery approach. 



' A 
18^ 



58% 



C 

14% 



0% 2.0 



It takes too long, before the claSs A 
returns to a topic. 0% 



B 

37% 



45% 



18% 2.8 



It is more interesting for students A ^j' B C 

than a mastery approach. 27% 64% 09% 



0 

0% 



1.8 



Students never master cbntent^ 



83% 



D 

17% 



3.2 



Teachers' responses showed an overall agreement with the program's 
philosophy ( i.e., they agreed with all positively framed questions and 
disagreed with all negatively framed questians) but most questions about the 
spiral/mastery dimension elicited both "strongly agree" and "strongly 
disagree" responses. 



Training 



" Before you began teaching CSMP : ■ • ■ 

How many hours of CSMP training did you receive?" 



None 


0% 




10 


25% 




10-15 


21% 




16-39 


25% 




1 CEMREL Workshop (or its 


08% 




equivalent for 40-50 hours) " 






2 CEMREL Workshops (or, the- 


^ 21% 




equivalent pf more than 






50 hours) 






Mean number of hours 


29 





\ 
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"How were those ^'pre-CSMP traini Ay^ssions scheduled?" 



A^ssi 

efor?H[- 



a week or two of training befor^Hhe program began 
a day or so before plus regularly scheduled 

meetings throughout the year 
a day or so before 



89% 
11% 

0% 



"What percentage of the training sessions were devoted to...?" 



Overview of the program's philosophy and goals 14% 

(05%-50%) 

Discussion/presentation of math content by trainer » 40% 

(05%-85%V^ 

Demonstration/discussion by trainer of specific lessons 30% 

(05%-75%) 

Practice by participants of teaching various lessors 16% 

(0%-40%) 



" After you began teaching CSMP : 

* How many hours of CSMP training did you have?" 



None 


84% ■ 


10 hours 


045!r 


20-30 hours. 


- ■ 08% 


45 hours 


04% 



Comments: 

The majority of CSMP teachers have had less than the mandated 40^ hours of 
pre-CSMP training. In fact, nearly half had less than 15 hours^ The vast 
majority of teachers received this training in a block' of time before 
beginning the program. Time in the training sessions was most frequently 
spent on discussions/presentations of math content and 
demonstration/disQussion of specific lessons. "Ijie overwhelming majority of 
teachers received no training after starting to teach CSMP. 



For those teachers who did attend, their attendance was voluntary, anff^^^ 
sessions were usually regularly scheduled throughout the year. The trainer 
varied at each site*, one site had the services of a CSMP/CEMREL trainer, 
another a local teacher, another two were led by local administrators given 
CSMP responsibility. 



« 3. CSMP Supplementing 
"If you taught CSMP before, how does your supplementing this year compare 
to last year?" 



Same 


54% 


/ 


More 


38% 


Less 


8% 




Topics supplemented were: 






Measurement/Metri cs 




40% 


Fractions 




40% 


Decimals 




30% 


Percent 




30% 


Basic Operations/Computation 




30% 


■Multiplication 




20% 


Division 




02% 


Place Value 




20% 


Problem Solving 




10% 


Estimation 




10% 


Geometry 




10% 



Less supplementing occurred with multiplication and divis.ion. 

The majority of teachers who have taught CSMP before report supplementing 
about the same, but 38% reported spending more time. 

In addition to collecting data on teachers' implementation and attitudes, 
we also attempted to relate the findings from the 1982 round of MANS testing 
to the implementation variables. However 'the data from both CSMP and Non-CSMP 
classes showed that no variable op cluster of variables explained differences 
in MANS scores from one class to another. 
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Appendix A 



CSMP and Non-CSMP Evaluations 



» 3. 
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"What are the best aspects of your present program? 

(A complete listing of both CSMP and Non-CSMP^ teacher statements.) 

CSMP . 

Analytic thinking skills, the ability to see there are often many 
solutions to a problem and a variety of ways to attach it; probability, 
' Creativity of lessons, format pre-planned, supplemental materials, 
workbooks and worksheets at every level. 

The book presents most concepts presented in th.e Curriculum Guide. 
The detailed math curriculum we have worked out. 
Student involvement with mathematics, not basic skills alone 
Challenging to bright student provides plenty of material so students 
can seek their limit, teaches mathematics not arithmetic. 
High motivation, developing .some enthusiasm for math, striving to become 
proficient and excel for learning's sake* 
The- logical thinking as well as abstract thinking^ 
Challenging material presented; logical thinking stressed. 
Interesting material, a variety 6f problems; student interest is high. 
Flexibility. 

; Enthusiasm the lesson elicits from students, collective problem solving 
^ interaction among students. , . - 

Utilizing lessons caused logical thinking in conjunction with basic math 
facts and operations. . 3. 
Stress on logic, probability. 

Spiral approach, creative thinking, student enthusiasm, challenge to 
A teacher. 

Challenge to all students, good for above average and high level students, 
- encourages problem solving; analyzing and predicting; high levels of 
thinking. ^Presents number bases quite well. 

Creative, challenging, diverse. The spiral approach is very effective. 
Spiral., 
Challenge. 

The spiral except for below, average students; excellent for above average 
students. Wide variety of experience. Helps promote logical "reasoning. 
Entire program is great ' 



4 



ERLC 



3. 



\ 



NON-CSMP 

5 

Small group work, inter-student help, only reinforcement type homework. 
Kids kept on the same presentation level but the pilot program allows kids 
who excel! to be challenged. I know where each student is regarding math 
needs. There are many possibilities for teaching and review. , 
Concepts are logically presented. ^ 
Adequate dril 1 . ' - -• 

J're-test/post-test.' 

The activities are good (generally). *" 
I try to use the banded approach and a variety of materials. 
. . Assignments cover a wide range of ability levels, ^uch extra practice 
where needed is available. The text doesn't assume students understand 
the materials. An excellent step by step approach. Lessons follow in a - 
logical sequence. ^. 

Allowing each student to progress and not get |;^G^ged down by -slower" 
stuhdents. 

Individuality, Letting a child move at his own rate. 
Work is clearly presented and logically ordered and developed. Immediate 
reinforcement on a daily basis. Set up lessons according to individuals 
needs. 

Great for average or below average students* 
Presentation of new material is rather thorough. 

Plenty of good problems. Good word problems. The text i^s excellent. 

•J 

It*s a Joplin Plan; 'We only have two levels to teach and we ar$ able to 
move at a faster rate to master our skills. 
Flexibility. 

Organization, business-like atmosphere, retaining interest in doing well. 
Good enrichment program, flexible enough to provXde for acceleration, fun. 
Ability grouping with supplemental work. { 

Student achievement and interest for the most part have been excellent. 



"What are the worst aspects of your present program and what changes in 
content do you. recommend?" 

(A complete listing of both CSMP and Non-CSMP teacher statements.) 
CSMP 

Provide Inore standard -algorithms in addition to what is now present and 
skill sheets^ For further enrichment and remediation, som6 standard 
evaluation means. 

More traditional algDrithms ©n fractions, decimals, long division, percent 
area and volume; need assessment tests on a regular basis fdr report cards 
Nothing. 

Text provides very few word problems. Organization of staff requires 
Idrger^ groups than I feel are good. Add staff to reduce class size. 
Answer keys are not printed for easy use.. 

Too much correcting time required on open-ended questions; spiraling is 
too spread out. 

Several lessons should be taught together. 

Overc<)min^ the apathy and resistance of a very small minority of students 
and parents. 

Not enough drill on repetition of basic skills; how to do fractions and 
, decimal s, percentage. 

Much teacher preparation; condense manual; hard to evaluate, include 
testing material . 

Dealing with low students on lessons that are heavy in logical thinking. 
Hard to reteach; help to have extra examples on strategies for low ability 
students with their shorter attention span, we need more explanation to 
help us prepare lessons. 

Spiral leaves mastery^ on too incidental a basis; students not math 
oriented tend to stay lost and have difficulty seeing the importance of 
progress. 

Reorganize some topics (like rounding in the first semester), add more in 
fraction area, redo geometry making It much more difficult, 'and spread out 
workbooks so students do a little every day. 

s 



Low ability students often left behind* They turn off. Program is not 
for everyone. -More provisions for individual differences should be made. 
Some lessons are long ^aiid there i,s not enough time for individual help and 
" rest of curriculum is short changed. 
Not enough drill on probleiiis they should know by for grade. Hard to give 

\ : 

grades. - X. ' ' 

Not enough word problems* Geometry not appropriate or needed at this 

grade levej* Too many lessons on number bases. 

Sti^ents lack practice with computational skills and slow students are 
lost. Lesson pages are difficult to find and there is a lack of 
explanation for difficult worHbook and worksheet pages. Lessons too long 
for stud0its and students don't get to move about and go to the board* 

^/ None . ' 

NON-CSMP 

Classes are way too large, and there is no aide assistance. I would like ' 
to have a wideV variety of materials to choose from. 
More help to ensure success by all students. 

I sometimes need an aide because I'm running two groups, -and I run out of 
time. 

I prefer the spiral approach of CEMREL* Our present program masters one 

topic before moving on* ^ , 

Not enough word problems; need to work on problem solving. 

Needs more variety; more advanced math concepts could be taught in this 

grade. 

More word problems that apply to daily living. This text is too easy for 
brighter students. 

There is a greater need for practical verbal problem solving of problems 
that would come up in daily living* 

4. 

Not enough pre/post-tests* ^ i^-:^^.^ 

I would suggest prime factoring as a way of reducing before multiplying 

fractions. 

It would prove helpful at times to work with on major concept (fractions 
through all operations rather than breaking after one small segment). 
Old books* 

Problem solving poor. I'm using new (Weekly Reader) materials called 

problem solving strategies* 

Lack of story ^probl ems; lack of adequate drill. 

Not enough problem solving review and applications of skills le^^rned 

earlier. Once a concept is learned it Is not adequate reviewed throughout 

the year* 3^^ 

Not challenging enough for the best students, not enough story problems; 

nr^t pnntmh rpinfnrr.Pmpnt ct.vlfi questions, - : ^ 



